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Abstract 

The  work  under  ONR  contract  N00014-77-C-0511  is  described. 
This  work  consists  of  the  development  of  a number  of  statistical 

f » 

techniques  useful  in  solving  search  problems.  Among  these  are 

the  employment  of  Bayesian,  minimax,  and  maximum  likelihood 

inferential  techniques  in  the  estimation  of  the  position  of  a 

moving  target  during  a search.  An  application  of  potential 

theory  to  search  problems  is  also  considered.  This  document 

r 

summarizes  the  results  detailed  in  Johns  Hopkins  Technical 
Reports  numbered  278,  280,  283,  286,  291,  295,  297,  and  301. 


FINAL  REPORT 


ONR  CONTRACT  NOOO14-77-C-0511 

STATISTICAL  METHODS  IN  SEARCH 


1.  Introduction 

The  work  performed  under  OMR  contract  N00014-77-C-0511  from 
September  1,  1977  through  June  30,  1978  has  been  addressed  to  de- 
veloping new  methods  for  planning  and  analyzing  search  for  moving 
targets.  These  methods  were  developed  for  application  to  ASW 
search  in  the  DS  and  SAI  missions. 

Recent  work  at  various  fleet  locations,  including  COMSUBPAC 
and  COMSUBLANT,  has  centered  around  the  development  of  programs 
written  for  desk-top  calculators  such  as  the  Wang  2200  and 

Techtronix  4051  to  address  the  ASW  search  problem.  In  particular, 

< 

approaches  have  been  developed  for  computing  target  location  dis- 
tributions, called  probability  maps,  on  these  small  calculators. 
Previously  such  technology  was  only  available  on  large,  high-speed 
computers.  These  newly  developed  programs  have  been  used  at  sea 
and  on  shore  for  the  solution  of  search  problems  inherent  to  the 
DS  and  SAI  missions. 

These  new  calculator  programs  have  made  probability  maps  avail 
able  for  the  first  time  to  the  at-sea  commander.  For  example,  the 


versions  of  the  so-called  'analytic*  programs  designed  for  use  in 
the  D3  mission  have  been  used  successfully  In  both  planning  and  real- 
time analysis  in  many  Pacific  Fleet  exercises  since  1975.  These 
DS  programs  represented  the  first  real  access  of  a commander  at  sea 
to  a complex  search  information  processing  system. 

The. key  to  this  new  capability  lies  in  the  fact  that  the 
'analytic*  programs  are  implemented  on  portable  desk-top  calculators , 
rather  than  on  large  stationary  computers,  as  are  the  so-called 
.'Monte  Carlo*  programs.  This  portability  has  proved  extremely  use- 
ful in  many  operational  search  problems.  On  the  other  hand,  this 
flexibility  has  not  been  achieved  without  cost.  In  general  terms,  this 

f 

coBt  has  been  in  the  reduced  versatility  of  the  'analytic*  programs 
relative  to  the  'Monte  Carlo'  programs. 

The  'analytic'  search  programs  differ  from  the  'Monte  Carlo' 
search  programs  in  the  way  in  which  probability  maps  are  computed. 
Instead  of  obtaining  a probability  map  from  a complex  sampling  pro- 
cedure, the  'analytic'  programs  compute  it  directly.  The  complexity 
of  the  sampling  procedure  inherent  in  the  'Monte  Carlo’  programs 
has  resulted  in  their  implementation  on  large,  high-speed  computers. 

While  less  demanding  in  terms  of  programming  requirements,  the 
current  'analytic*  programs  rest  on  a highly  specialized  body  of 
mathematical  assumptions.  These  have  been  shown  to  have  wide  appli- 
cability in  ASW  search  problems;  however,  they  are  still 
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significantly  more  restrictive  than  those  underlying  the  'Monte 

Carlo'  programs.  As  a result,  the  'analytic'  programs 

are  considered  less  versatile  than  the  'Monte  Carlo'  programs. 

The  work  that  ha3  been  performed  under  ONR  Contract  N00014-77-C-0511 
has  been  addressed  to  enhancing  the  versatility  of  search  program- 
ming implement  on  small  desk-top  calculators.  The  sole  purpose  of 
this  enhancement  is  to  make  useful  tactical  decision  aids  available 
on  portable  computing  systems  for  the  UBe  of  the  on-scene  commander. 

Two  major  objectives  of  the  work  have  been t 

1.  Generalization  of  existing  modeling  and  inferential 
techniques  in  order  that  the  desk-top  'analytic'  pro- 
grams may  be  applied  tp  a wider  range  of  search 
problems » and 

2.  Automation  of  a number  of  the  features  of  the  current 
'analytic'  programs  in  an  attempt  to  reduce  the  role 
of  the  analyst  in  the  solution  of  operational  search 
problems. 

These  objectives  have  been  addressed  through  technical  progress 
In  three  important  areas: 


1.  Generalization  of  the  models  for  target  motion  and 

models  for  sensor  operation  employed  in  the  ’analytic' 


programs ; 
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. Development  of  statistical  procedures  for  esti- 
mating the  position  of  the  target  without  stipulating 
a prior  distribution  for  the  target t and 
3.  Development  of  statistical  procedures  for  optimal 
real-time  sensor  allocation. 

These  technical  advances  have  been  made  within  the  context  of  the 
development  of  general  statistical  methods  to  address  search  problems. 

The  Bayesian  statistical  analysis  which  currently  provides  the  inferential 
structure  of  both  the  ’analytic'  and  'Monte  Carlo'  programs  is  only 
one  of  many  possible  statistical  techniques  for  making  inference 
about  the  position  of  a target  during  a search,  rln  an  attempt  to 
address  the  objectives  of  this  contract,  the  application  of  other 
known  statistical  techniques  to  the  problem  of  target  localization 
was  investigated.  The  result  of  this  investigation  is  a body  of 
statistical  tools  for  estimating  the  position  of  a target  during  a 
search  which  significantly  generalizes  currently  employed  inferential 
techniques. 

These  new  tools  will  be  briefly  described  in  sections  3,4,5 
and  6.  An  introduction  to  the  U3e  of  statistics  in  the  theory  of 
search  will  be  presented  in  section  2.  A compendium  of  the  abstracts 
of  the  technical  reports  referred  to  in  sections  3,  4,  5 and  6 will 
be  given  in  section  7.  Each  statistical  technique  referred  to  in 
sections  3,  4,  5 and  6 is  in  the  form  of  an  algorithm  which  may  be 


either  incorporated  into  existing  ‘analytic'  programs  or  written 
into  a new  program  for  use  on  a desk-top  calculator.  In  each  case, 
suggestions  for  the  applicability  of  each  technique  will  be  made. 


2. 


The  Use  of  Statistics  in  the  Theory  of  Search 
The  problem  of  target  localization  may  be  viewed  as  a statis- 
tical estimation  problem.  In  a typical  search  problem,  a target  is 
assumed  to  be  moving  in  a' region  known  as  a search  space . uncer- 
tainties are  typically  associated  with  both  the  Initial  position 
of  the  target  and  the  manner  in  which  the  target  moves  from  the 
initial  position  through  the  search  space. 

A searcher  is  one  who  chooses  a sequence  of  random  variables 
to  sample  in  order  to  make  inference  about  the  position  of  the 
target  during  the  search.  One  random  variable  is  chosen  at  each 
stage  of  the  search.  For  example,  a random  variable  with  outcomes 

r 

detection  and  non-detection  may  be  associated  with  the  search  of  a 

subregion  of  the  search  space  called  a cell.  Then,  in  choosing  a 

sequence  of  cells  to  be  searched  the  searcher  is  really  choosing 

a sequence  of  binary  random  variables  to  be  sampled.  The  sequence 

of  random  variables  chosen  ‘from  time  0 through  to  time  t is 

» • * • 
called  the  experiment  associated  with  time  (or  stage)  it. 

At  each  time  t the  searcher  may  observe  the  outcomes  of  the 
experiment  associated  with  time  t.  This  amounts  to  observing  or 
recollecting  the  outcomes  of  all  the  random  variables  chosen  for 
sampling  between  time  0 and  time  t . When  a random  variable  is 
associated  with  the  search  of  a cell  this  is  equivalent  to  observ- 
ing either  a detection  or  non-detection  during  the  search  of  that  cell 


*6- 


The  searcher  then  has  two  problems  to  address.  His  immedi- 
ate problem  is  to  vise  the  outcomes  of  the  experiment  associated 
with  time  t to  construct  an  estimate  for  the  position  of  the 
target  at  time  t.  This  is  a problem  in  statistical  inference. 

A more  subtle  problem,  but  one  of  equal  importance,  involves  the 
choice  of  the  experiment  associated  with  time  t . This  is 
actually  a problem  which  must  be  addressed  prior  to  the  construc- 
tion of  the  estimate.  It  is  a problem  in  experimental  design. 

. . In  point  of  fact,  these  two  problems  are  intimately  con- 
nected. This  is  because  the  searcher  must  choose  the  experi- 
ment associated  with  time  t to  optimize  some  property  of  the 
target  location  estimator  which  he  constructs  at  time  t.  This 
criterion  for  optimality  usually  involves  a payoff  function 
which  places  more  value  on  estimates  which  are  close  to  the 
actual  target  position  and  less  value  on  estimates  which  are 
more  distant.  The  objact  of'  search  planning  then  is,  for  any 

t'  ' • 

time  t to  choose  an  experiment  dissociated  with  time  t and 
an  estimator  for  target  location  at  time  t which  maximizes  the 
average  payoff  to  the  searcher. 

To  summarize,  there  are  six  basic  components  of  the  statis- 
tical inference  problem  which  confronts  the  searcher  at  time  t. 
i)  © •»  {0}  - Search  Space . This  is  the  set  of  possible 
locations  for  the  target  during  the  search.  It  is 


A 


assumed  that  the  target  starts  from  one  of  the  elements 
of  © and  at  any  time  during  the  search  is  still 
located  at  some  element  of  © . 

ii)  Efc  - {et>  - Family  of  Experiments.  This  is  the  collection 
of  all  experiments  associated  with  time  t , denoted  by 
efc,  which  the  searcher  may  use  in  order  to  estimate  the 
position  of  the  target  at  time  t.  An  element  e^.  of 
Efc  is  just  a sequence  of  random  variables, 

iii)  Zt  {at>  - Sample  Space . This  is  the  set  of  all  possible 
outcomes  of  the  experiments  associated  with  time  t. 

Having  chosen  an  element  e^,  of  E^.  the  searcher  observes 

I an  outcome  z.  in  Z,  . , 

t t 

iv)  y s © x © -*■  1R  - Payoff  Function.  The  value  y(6,a)  is 
the  payoff  to  the  searcher  if  he  estimates  the  target's 
position  at  time  t to  be  at®  and  it  is  actually  0£©  • 

v)  G = ® -*■  [0,1]  - Prior  Distribution.  The  value  G(0)  Is 
the  prior  probability  that  the  target  starts  at  time  0 
at  location  0 6©  . 

vi)  F‘Et  x Zfc  x © * © [0,1]  - Observation  Distribution. 

The  value  ,0 tl ttie  Probakility  of  the  events 

target  is  located  at  6tG©  at  time  t and  outcome  zfc 
has  been  obtained,  given  the  target  started  at  location 
0q6©  at  time  0 . 
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The  problems  of  statistical  inference  and  experimental  design 
discussed  above  involved  in  predicting  target  location  at  time  t 
Kay  then  be  regarded  as  a game  between  the  searcher  and  the  target. 
The  essential  elements  of,  tha  g .ante  are  the  six  basic  components  of 
the  estimation  problem  Hated  above.  Different  forms  of  statisti- 
cal inference  amount  to  different  rules  by  which  tha  target  and  the 
searcher  are  assumed  to  play  this  game.  * 

During  the  work  under  this  contract,  three  form3  of  statistical 
infarenca  were  considered j Bayesian  inference,  minimax  estimation, 
and  maximum  likelihood  estimation.  Within  the  context  of  the 
search  problem, these  different  forms  of  inference  result  from! 

i)  different  assumed  mechanisms  for  the  target's 
choice  of  starting  position,  and 
ii)  different  payoff  functions. 

Hie  game  batween  tha  searcher  and  the  target  at  any  time  t may  be 
represented  graphically  as  An  Figure  !.■ 


• Ffqura  1^ 

Th*a  Game  Ba tween  tha  Searcher  and  Target 
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The  game  may  be  considered  as  a four  move  game,  with  the  target 


aadth#  searcher  alternating  moves. 

>In  the  first  move  the  target  chooses  an  initial  position.  In 

Bayesian  inference  it  is  assumed  that  this  choice  is  made  randomly, 

using  the  prior  distribution  G as  the  randomization  mechanism. 

In  both  minimax  estimation  and  maximum  likelihood  estimation,  no 

such  assumption  is  made.  Rather,  it  is  assumed  that  the  target's 

initial  position  io  chosen  completely  arbitrarily. 

The  second  move  is  the  searcher's.  To  address  the  problem  of 

estimating  the  target's  position  at  time  t , he  chooses  an  experiment 

associated  with  time  t,  denoted  e.  . The  searcher  is  free  to 

t 

choose  any  element  of  . 

In  the  thrid  move  the  target  makes  two  choices*. 


i) 

an  outcome 

z £ Z • 
¥ t ' 

ii) 

a location 

etf©  . 

Once  again  it  is  assumed  that  tha  target  is  not  free  to  choose  any 
pair  ( at*et)  hut  rather  mu3(t  choose  the  pair  randomly  from  the  dis- 
tribution Fr  (.,.|V  Note  that  the  distribution  of  * 3 

conditioned  upon  the  choices  0Q  and  which  were  determined 

earlier  in  the  game. 

The  fourth  move  is  the  searcher's.  Having  observed  outcome 
he  must  choose  an  element  a of  © as  his  estimate  for  the 
location  of  the  target.  The  searcher  is  free  to  choose  any 
element  of  @ 
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After  the  target  and  searcher  have  completed  two  mcvoB  each  , 
a referee  pays  the  searcher  fin  amount  pO^.a),  where  1b  the 

position  of  the  target  at  time  t known  only  to  the  referee  and  n 
is  the  searcher’s  estimate  of  that  position.  It  is  assumed  that  the 
mechanism  for  calculating  the  payoff  was  fixed  before  the  gome 
b tar ted. 

In  Bayesian  inference  and  minimax  estimation  the  payoff  func- 
tion is  typically  a function  which  decreases  with  increasing  dis- 
tance between  real  and  estimated  target  position.  In  maximum 
likelihood  estimation  the  payoff  function  is  related  to  the 
asymptotic  variance  of  the  estimate  of  the  target's  position.  These 
ideas  will  be  made  precise  in  the  next  sections. 

In  section  3 the  Bayesian  approach  to  this  estimation  prob- 
lem will  be  discussed  in  greater  detail.  In  particular  the 
technical  reports  written  to  address  specific  search  problems 
within  the  Bayesian  context?  will  be  briefly  discussed.  Applica- 
tions for  which  the  Bayesian  approach  to  estimation  is  appropri- 
ate will  also  be  suggested. 

In  section  4 the  minimax  estimator  for  target  location  will 
be  addressed  in  greater  detail.  Technical  reports  using  this 
statistical  technique  to  address  specific  search  problems  will  be 
discussed  and  applications  of  this  inferential  technique  mentioned. 


In  section  5 the  maximum  likelihood  approach  to  estimation  of 
target  location  will  be  further  developed  within  the  context  pre- 
sented hera.  Discussion  of  material  addressed  to  specific  search 

' » 
problems  within  this  inferential  framework  will  be  presented  along 

with  suggestions  for  the  applicability  of  this  approach. 

In  section  6 an  application  of  a different  branch  of  mathe- 
matics called  potential  theory  to  the  search  problem  is  discussed. 
Applications  for  this  technique  are  mentioned.  All  technical  re- 
ports discussed  in  these  four  sections  are  abstracted  in  section  7. 


3.  Bayenian  Search 

In  this  auction  tho  Bayesian  solution  to  the  estimation  problem 
introduced  in  section  2 will  be  discussed  in  detail.  Use  of 
Bayesian  inference  to  address  specific  search  problems  has  been 
considered  in  four  technical  reports.  These  reports  will  be 
briefly  discussed  below.  Applications  for  the  results  of  these 
reports  will  also  be  addressed. 

A.  The  Bayesian  Estimation  Problem 

As  was  mentioned  in  section  2 , the  general  estimation  problem 
inherent  to  a search  may  be  characterized  as  a four-move  game  with 
a payoff  at  the  end.  The  differences  in  this  game  under  different 

- r 

forms  of  statistical  inference  are  differences  in  the  mechanisms 
for  choice  in  move  #1  and  in  the  characterization  of  the  payoff. 


Consider  the 

Bayesian’s 

version  of 

the  estimation 

game  displayed 

in  Figure  2. 
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The  Bayesian  Searcher  assumes  that,  in  move  #1,  the  target 
chooses  its  initial  position  0Q  using  the  prior  distribution  G. 

In  move  #2  the  Bayesian  search  must  choose  an  experiment  associated 
with  time  t,  a,  . He  does  thia  assuming  that  he  knows  the  * 
prior  distribution  G with  which  the  target  has  chosen  its  initial 
position  0Q  . In  the  third  move  the  target  must  choose  a position 
at  time  t,8^  and  produce  an  obeervatian  z^..  The  target  is  assumed 
to  know  both  its  initial  position  0Q  and  the  form  of  the  obser- 
vation distribution  F (*,*|g,).  In  the  fourth  move  the  Bayesian 

C ' 0 

t 

searcher  must  choose  or.  estimate  a of  0fc  . He  does  this  with  a 
knowledge  of  the  prior  distribution  Gj  the  experiment  which  he 
chose  at  move  #2,  t the  observation  distribution  F^  (*,*|0q)> 
and  the  observation  z . The  referee,  knowing  both  0^  and  a 
pays  the  searcher  an  amount  u (0^.,a)  . The  problem  for  the 
Bayesian  searcher  is  how  to  choose  experiment  e and,  given 
observation  zt  , how  to  choose  estimate  a , so  as  to  maximize  his 
expected  payoff. 

B . The  Solution  to  the  Bayesian  Estimation  Problem. 

The  solution  to  the  Bayesian's  optimization  problem  is  a two- 
step  solution: 

i)  For  any  given  experiment  cttEfc  , choose  an  estimator  a(‘) 
to  maximize  the  expected  payoff  under  experiment  efc  . 


-14- 


r 


This  expected  payoff,  denoted  by  (a)  , is  given  by« 

r (a)  - / G(d8)  / 7 F (ds,dt|0)u  (<f>,a(z))  . 

p y (B  k 

t © . © *t  * 

If  a*  maximizes  r (•)  , then  a*  is  called  o Bayes  Estimator 

et 

for  8^  undor  experiment  . The  value  rg  (a*)  is  known  as 

t 

the  Bayes  payoff  under  experiment  e^  . 

ii)  Once  a Bayes  estimator  a*  has  been  selected  for  each  experi- 
ment et€  St  , the  optimal  experiment  is  to  be  chosen.  The 
optimal  experiment  associated  with  time  t , denoted  efc* , is 

that  member  of  E.  which  maximizes  r (a*)  . The  value  r .(a*) 
t e^_  , efc" 

is  than  called  the  Baye3  payoff. 

C.  Technical  Reports 

Four  technical  reports  were  written  under  this  contract  to 
employ  thi3  Bayesian  solution  to  specific  search  problems.  These 
reports  are  as  follows i « 

1 . Search  for'  <a  Moving  Target  and  the  Exponential  Formula. 

2 . Statistical  Methods  in  the  Theory  of  Search. 

I.  Parametric  Search  Modeling. 

I . On  Multiplicative  Functionals  on  Diffusion  Processes . 

These  technical  reports  are  abstracted  in  section  7. 

D.  PiacusBlon  of  Technical  Reports 

All  four  of  these  technical  reports  apply  Bayesian  inference 


to  the  problem  of  search  for  a continuously  moving  target  in 
Euclidean  n-ap*ce.  it  is  asauaed  that  the  Bearch  is  conducted  by 
many  sensors  moving  continuously  in  !Rn»  Methods  for  representing  the 
Bayes  estimator  for  the  target's  position  at  any  time  during  the 
search  are  developed.  These  representations  are  based  upon  parti- 
cular methods  for  parameterizing  the  model  for  target  motion  and 
the  operation  of  the  sensora  conducting  the  search.  The  techni- 
cal reports  include  examples  of  the  use  of  the  representations  in 
polving  specific  search  problems.  The  algorithms  presented  in  the 
technical  reports  may  be  implemented  on  small  desk-top  calculators. 

E.  Applications  of  Bayesian  Inference 

r 

i)  General  Considerations : The  assumptions  inherent  to  the 
Bayesian  solution  of  the  target  localization  problem  presented  in 
the  technical  reports  listed  above  limit  this  technique's  useful- 
ness in  two  important  way a.  First,  in  order  to  use  Bayesian 
inference  successfully,  the*  assumption  that  the  target  chooses  its 

i *•  ' 

initial  position  from  a known  prior  distribution  must  hold.  This 
is  a key  assumption  in  the  Bayesian  framework  and  one  which  is 
difficult  to  justify  tactically. 

Typically  there  la  little  reason  to  believe  that  a target  has 
chosen  its  initial  position  randomly  from  a particular  distribution 
and  almost  never  a reason  for  the  searcher  to  contend  that  he  knows 
the  form  of  thiB  distribution.  Arguments  can  be  made  that  the 
prior  distribution  should  reflect  the  searcher’s  knowledge  rather 
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than  an  objective  selection  mechanism  used  by  the  target.  These  ar' 

gumant3  result#  howaver,  in  inferential  models  for  the  searcher 's 

speculations  rather  than  models  for  the  target's  actual  location. 

* 

A second,  more  technical  problem  inherent  in  the  representa- 
tions developed  in  the  technical  reports  involve  their  complexity. 
What  may  realistically  be  programmed  on  a small  de3k-top  computer 
are  approximations  to  the  Baya3  estimators  derived  in  the 
technical  reports.  Practically,  this  means  that  when  implemented 
on  small  calculators,  only  simple  models  for  target  motion — such  as 
diffusions— and  simple  models  for  sensor  operation — such  as  ones 
involving  only  direct  path  and  one  convergence  zone — should  be 
employed.  Of  course,  when  implemented  on  larger  computers ,.  more 
complex  models  of  tho  type  suggested  in  the  technical  reports 
may  be  employed. 

ii)  Specific  Considerations . The  results  obtained  in  these 
four  technical  reports  generalize  the  methodology  underlying  DS 
and  SAl  'analytic'  programs  currently  in  use  at  the  RUBPAC  TAG. 
Specifically,  the.se  technical  reports  significantly  generalize  the 
types  of  models  for  target  motion  and  models  for  sensor  operation 
which  may  be  considered  by  programs  of  the  'analytic'  type. 

Improved  procedures  for  representing  the  'analytic'  solution  to 
the  Bayes  estimation  problem  have  also  been  developed  here.  These 
improvements  could  be  incorporated  into  existing  DS  and  SAl 
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'analytic'  programs.  Tor  the  specifics  of  these  generalizations 
the  reader  ia  referred  to  the  technical  reports. 
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4.  Minimax  Search 


In  this  section  the  minimax  solution  to  the  estimation  problem 
introduced  in  section  2 will  be  discussed  in  detail.  Use  of 
minimax  estimation  to  addrasB  specific  search  problems  has  bean  con- 
sidered in  two  technical  reports.  These  technical  reports  will  be 
briefly  discussed  below.  Potential  applications  for  these  results 
will  also  be  discussed. 

A.  The  Minimax  Estimation  Problem 

• - Once  again  we  return  to  the  general  target  localization  problem 

outlined  in  section  2.  It  was  shown  that  this  problem  may  be  charac- 
terized as  a four-move  game  with  a payoff  at  the  end.  Now  consider 

r 

a version  of  this  game  based  upon  minimax  estimation.  Such  a version 
is  displayed  in  Figure  3.. 

The  game  proceeds  as  in  the  case  of  the  Bayesian  searcher,  ex- 
cept that  at  move  #1  the  target  choossB  an  initial  position  0Q  freely, 

i , 

without  the  aid  of  a prior  distribution.  Consequently,  when  the 

• ■ ■ , ' 

searchers  chooses  an  experiment  efc  , he  does  so  without  any  infor- 
mation regarding  the  choice  of  the  initial  position  which  the  target 
haa  made.  Thus,  uaa  of  a minimax  estimation  philosophy  may  be  em- 
ployed under  a relaxation  of  the  assumptions  used  by  the  Bayesian  to 
generate  his  solutions  to  the  search  problem. 

Yet,  as  in  the  case  of  the  Bayesian  searcher,  a searcher  using 
minimax  estimation  must  still  decide  at  move  #4  how  to  choose  an  esti-^ 
mate  for  the  target's  position  at  time  t , and  at  move  #2  decide 
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Figure  3 
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upon,  an  experiment  to  be  employed. 

Vfhat  makes  his  problem  more  difficult  than  the  Bayesian's  is  that  he 
must  make  these  decisions  without  the  luxury  of  assuming  he  knows  the 
random  mechanism  used  by  t'qo  target  for  generating  his  initial  position. 
B . The  Mlnimax  Solution  to  the  Estimation  Problem 

Ae  before,  the  tninimax  aolution  to  this  problem  is  a two-step 
solution. 

i)  For  a given  experiment  t choose  an  estimator  a(*) 

to  maximize  the  minimum  expected  payoff  under  experiment  et  . The 

minimum  expected  payoff,  denoted  by  R (a)  is  given  by, 

et 

R (a)  = min  / / F (dz,dij>  1 0 ) y (<f>  ,a  (z) ) . 

6fc  0 ® zt  Pt 
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These  technical  reports  are  abstracted  in  section  7. 

i 

D . Discussion  of  Technical  Reports  - . 

Both  of  these  technical  reports  apply  minimax  estimation  to 
particular  search  problems.  In  both  cases  the  target  is  assumed  to 
choosa  its  initial  position  at  an  unknown  posiiton  In  the  search 
space.  In  these  technical  reports  a discrete  search  space  is  con- 
sidered. The  case  of  a stationary  target  (or  a moving  target  which 
moves  very  slowly  with  respect  to  changes  in  the  search)  is  con- 
sidered in  the  first  technical  report.  In  the  second  technical 


h 
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report  the  target  is  assumed  to  move  discretely  through  the  search 
space  according  to  a Markov  process.  Representations  for  the 
minimax  estimator  for  target  position  and  the  value  of  the  esti- 
ijatipn  gluaa  ara  derived  In  each  caa&..  As  a part  of  the  solution  in 
aao/vo****,?*  prior  distribution  for  tha  target  is  also  derived  vhieh 
would  be* tha  most  difficult  for  a Bayesian  searcher  to  consider. 

This  distribution  is  called  the  least  favorable  prior  distribution. 
E,  Applications  of  the  Mlnlmax  Estimator 

* . i)  General  ConBldaratlonai  Tha  minimax  estimator  may  be  used 
under  a relaxation  of  tha  assumptions  used  to  derive  the 
Bayesian  solution  to  the  target  location  estimation  problem.  The 
key  assumption  lacking  in  the  derivation  of  the  minima*  estimator 
1b  that  of  a prior  distribution  for  the  target’s  initial  position 
which  is  known  to  the  searcher.  However,  as  i3  pointed  out  in 
the  technical  reports,  there  is  a Bayesian  interpretation  for  the 
optimality  of  the  minimax  estimator. 

The  minimax  estimator  for  a target’s  position  at  any  time 
during  a search  is  in  fact  a Bayes  estimator  under  a very  speci- 
fic prior  distribution  for  tha  target's  initial  location.  Since 
no  prior  distribution  is  assumed  by  the  minimax  technique,  it 
automatically  proposes  a prior  distribution.  The  prior  distri- 
bution which  it  suggests  is  the  one  which  minimises  the  maximum 
payoff  to  the  searcher.  This  ia  the  least  favorable  prior  distri- 
bution mentioned  above.  The  minimax  estimator  is  then  a 
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Bayesian  estimator  with  respect  to  this  prior 


tribution. 


i 


Since  the  minimax  estimator  chooses  as  its  implied  prior  dis- 
tribution for  the  target’s  initial  position,  the  one  which  produces 
the  most  difficult  estimation  problem  for  the  searcher,  the  tfiini- 
max  estimator  is  inherently  more  conservative  than  the  Bayes 
estimator.  This  conservatism  means  that  the  estimator  will  admit 
more  possibilities  for  the  target's  position  at  any  time  t 
(and  be  consequently  less  definitive;  than  a Bayes  estimator  in 
the  same  search.  This  loss  of  precision  is  a direct  consequence 
of  the  relaxation  of  aasumptiona. 

The  conclusion  here  is  that  the  minimax  estimator  should  be 
used  only  when  a prior  distribution  for  the  target's  initial  posi- 
tion' is  not  indicated  and  then  only  if  it  is  of  interest  to  guard 
assiduously  against  making  mistakes  in  estimation.  The  minimax 
estimator  artificially  creates  a prior  distribution  to  guard 
against  large  mistakes.  Thb  use  of  prior  distributions  in  this 
way  tends  to  deemphaaise  the  importance  of  the  observations . We 
nhall  see  in  the  next  section  that  another  technique,  called 
maximum  likelihood,  may  be  used  in  similar  search  problems  (ones 
with  no  apparent  prior)  to  emphasise  the  role  ol  the  observations 
rather  than  the  role  of  the  real  or  implied  prior  assumptions  in 
making  inference  about  target  location. 


i 


ii)  Specific  Considerations i The  results  obtained  in  thc3e 


two  technical  reports  are  totally  new  results.  However,  the 

f 

modeling  of  target  motion  and  sensor  operation  employed  therein 

» P 


gre  of  the  same  type  as  is  currently  employed  in  the  SUBPAC  TAG'S 
Markov  chain  SAI  program  written  for  the  Wang  2200.  This  program 
currently  uses  a Bays3ian  estimator  for  target  position.  The 
algorithms  provided  in  the  technical  reports  could  be  written  into 
a subroutine  and  appended  to  the  aforementioned  SUBPAC  program. 

. . The  benefit  to  be  derived  from  such  an  addition  would  be 
in  the  expansion  of  tbs  type  of  tactical  3A1  situation  for  which 
the  programmed  techniques  would  be  applicable.  The  current  pro- 
gram, employing  Bayesian  techniques,  requires  detailed  information 
✓ 

about  the  target's  prior  distribution.  In  many  tactical  situations 
such  information  is  unavailable.  The  algor i thins  provided  by  the 
technical  reports  listed  above  do  not  require  stipulation  of  a 

prior  distribution  for  the  target.  Yet  they  produce  decision  aids 

> ’ * , 

for  the  search  planner  of  the  same  general  type  as  the  Bayesian, 
Markov  chain  SAl  program. 
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. Maximum  Likelihood  Search 


In  thia  section  the  maximum  likelihood  solution  to  the  esti- 
mation problem  introduced  in  section  2 will  be  addressed  in 

* * 9 
detail.  Use  of  maximum  likelihood  methods  to  address  a specific 

search  problem  ia  addressed  in  one  toe»iniual  report.  This  technical 
report  w.ili  be  briafly  discussed  in  subsection  D.  Potential  applica- 
tions for  these  results  will  also  be  discussed. 

A.  The  Maximum  Likelihood  Estimation  Problem 

Return  again  to  the  four-move  estimation  game  described  in 
section  2.  Consider  now  a version  of  this  game  baaed  upon  maxi- 
mum likelihood  estimation.  Such  a version  would  appear  identical 
in  its  rules  to  the  game  depicted  in  Figure  3k  , 

As  in  the  case  of  minimax  estimation,  at  move  #1  the  target 
chooses  an  initial  position  0Q  freely, without  any  enforced 
randomization  mechanism.  When  the  searcher  chooses  an  experiment 
e^.,  he  does  so  without  any  information  regarding  the  target's 
choice  of  0Q  . Once  again,  this  name  is  one  which  is  much  more 
difficult  for  the  searcher  since  he  has  less  information  upon 
which  to  base  h.is  choices. 

Yet,  as  in  the  case  of  minimax  estimation  and  Bayesian  esti- 
mation, the  searcher  must  decide  at  move  #4  how  to  choose  an 
estimate  for  the  target's  position  at  time  t,  and  at  move  #2  decide 
upon  an  experiment  to  be  employed. 


8.  The  Maximum  Likelihood  Solution  to  tho  Estimation  Problem 

As  in  the  previous  two  cases,  the  maxiimim  likelihood  solution 

to  this  problem  is  a two-step  solution. 

i)  For  a given  experiment  et€Et  and  the  observatiort  zt€Z^  , 

choose  as  an  estimate  of  target  position  at  time  t the  position  at(S) 

which  maximizes  the  likelihood  function.  For  et€Efc  and  Zt€zt  * 

the  likelihood  function,  for  a stationary  target,  denoted  f (jb  | • ) 

et 

is  given  by 


fet(2Ja)  - Fe^(zt»a|a)  * for  a£0- 

If  for  et£2t  and  zt^Zt'  a waxfmize9  fe  (ztl  * ) # 

then  a ie  called  the  maximum  likelihood  estimate  for  6^  under 

e^.,  for  observation  . 

ii)  The  optimal  experiment  associated  with  time  t (in  this 
caBe) , denoted  , is  that  member  of  Efc  which  maximizes  the 
minimum  Fisher  information.*  Here  for  ®tGEt  # the  minimum  Fisher 
information,  denoted  Hfe^)  is  given  by 


H(ot) 


min  / 
0 Z. 


yf  (z  I • ) 


f (dz,e|o) 


The  rationale  behind  this  two-step  solution  la  described  in  the 
technical  report  described  below. 
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C . Technical  Report 

One  technical  report  was  written  under  this  contract  on  the 
employment  of  maximum  likelihood  methods  in  search.  Thi3  report 
is  entitled  Maximum  Likelihood  Search . This  technical  report  is 
abstracted  in  section  7 . 

D.  Discussion  of  Technical  Report 

In  the  above  technical  report  the  maximum  likelihood  estima- 
tor for  target  position  la  examined  in  the  case  of  a stationary 
.target.  The  eearah  ia  conducted  by  a aet  of  sensors , each  one  of 
which  has  associated  with  it  an  instantaneous  probability  of 
detection  functions.  The  asymptotic  distribution  of  the  maximum 

r 

likelihood  estimator  for  the  target's  position  is  obtained  in  terms 
of  &ia3a  detection  function  Within  this  context,  it  is  demon- 
strated thut  Fi3her  information  arises  as  the  natural  criterion 
for  selection  of  the  optimal  experiment. 

E.  Applications  of  the  Maximum  Likelihood  Estimator 

I • 

i)  General  Considerations : The  maximum  likelihood  estima- 
tor, like  the  minimax  estimator  Ray  be  used  under  a relaxation  of 
the  assumptions  used  to  derive  the  Bayesian  solution  to  the  estima- 
tion problem.  This  relaxation  is  that  no  prior  distribution  is 
assumed  for  the  target. 

Like  the  minimax  estimator  for  the  target's  location,  the 
maximum  likelihood  estimator  nlso  has  a Bayesian  interpretation. 


When  the  nearch  space  has  finite  sice  (area  or  number  of  cells) , the 
maximum  likelihood  estimator  is  a Bayes  estimator  under  a very 
specific  prior  distribution  for  tha  target.  Since  no  prior  distri- 
bution is  assumed  by  the  maximum  likelihood  technique,  like  the 
minimax  technique,  it  automatically  proposes  a prior  distribution. 
The  prior  distribution  which  the  maximum  likelihood  technique  sug- 
gests is  one  which  represents  a completely  neutral  prior  opinion 
about  the  location  of  the  target.  It  should  be  construed  as  repre- 
senting complete  ignorance  about  the  location  of  the  target. 

Therefore,  the  maximum  likelihood  estimator  Btrives  to  deerapha- 
aize  tha  role  of  the  prior  assumptions  in  making  inference  about  the 
target' 3 location.  The  role  of  the  observations' then  becomes 
correspondingly  more  important.  Consequently,  while  the 
minimax  estimator  1b  less  sensitive  to  the  observations  than  the 
Baye3  estimator,  the  maximum  likelihood  estimator  is  more  sensitive. 
Small  changes  in  the  observations  may  produce  large  changes  in  the 
estimated  target  position.  This  is  due  to  the  fact  that  the  maxi- 
mum likelihood  estimator  relies  totally  on  the  observations  for  its 
conclusions.  In  the  same  vein,  the  Bayes  estimator  balances  the 
observations  against  specific  prior  assumptions?  and  the  minimax 
estimator  balances  the  observations  against  the  risks  involved  in 
estimating  the  target's  position  incorrectly. 

The  conclusion  here  1b  that  the  maximum  likelihood  estimator 
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should  fca  used  only  when  both  of  the  following  two  conditions  ace 
matt  i)  when  a prior  distribution  for  the  target's  location  is 
not  justified  and  ii)  when  objectivity  in  estimating  the  target's 

i * 

position  is  considerad  to  be  more  important  than  the  penalties 
involved  in  incorrect  estimation. 

ii) ‘ Specific  Considerations ; 'the  results  obtained  in  the 
above  technical  report  are  totally  new.  However,  the  modeling  of 
sensor  operation  used  in  the  report  are  of  the  3ame  type  as  is 
currently  employed  in  the  'analytic'  3A1  and  DS  programs.  These 

i 

programs  currently  use  Bayes  estimators  for  target  location. 

The  maximum  likelihood  estimator  dincuased  in  the  technical  re- 
port could  be  written  into  a subroutine  and  appended  to  either 
/ 

program.  Such  an  addition  would  be  useful  for  dealing  with 

tactical  situations  in  which  the  target  moves  significantly  more 

slowly  than  the  sensors  and  in  which  no  prior  distribution  ie 

s 

indicated.  . . 

* l * i , •»  » v 

It  should  be  noted  that  these  techniques  have  much  wider, 
applicability  than  just  as  possible  add-ons  to  existing  'analytic' 
programs.  The  maximum  likelihood  techniques  described  in  the 
technical  report  referenced  could  bs  slightly  generalized  and  applied 
to  submarine  vs.  submarine!  search  problems.  This  is  because  in  local 
tactical  problems,  a prior  distribution  for  the  target's  location  is 
rarely  justified.  In  such  cases  the  data  must  provide  all  the 


information  about  the  target's  location.  Maximum  likelihood 
methods  are  designed  for  this  purpose. 


6.  The  Search  Potential 


In  thl9  Bection  an  application  of  a totally  different  branch 

of  mathematica  to  the  search  problem  is  discussed — namely  poten- 

♦ » 
tial  theory.  The  methods  discussed  in  the  previous  four  sections 

have  been  addressed  to  developing  an  estimator  for  the  location  of 
a target-  in  a search  space  at  any  time  during  the  search.  These 
methods  have  their  primary  usefulness  in  real-time  search  problems! 
that  is# in  problem*  of  estimating  the  position  of  the  target  dur- 
ing the  conduct  of  a search. 

Methods  such  as  these  may  also  be  used  for  the  planning  of  a 
search  prior  to  its  actually  being  performed.  This  1b  the  problem 

of  choosing  the  optimal  experiment  discussed  above.  The  optimal 

* 

experiment  associated  with  time  t is,  for  any  given  inferential 
technique,  the  sat  of  random  variables  to  be  sampled  (or  search 
plan)  which  makes  the  estimator  for  target  location  at  time  t 

i 

most  efficient. 

l \ x 

Other  criteria  for  choice  of  search  plan  also  suggest  them- 
selves.  Often  a search  involves  an  attempt  on  the  part  of  the 
target  to  achieve  an  objective.  The  role  of  the  searcher  is  then 
to  detect  and  neutralize  the  target  before  it  achieves  its 
objective.  Consider  the  tactical  situation  outlined  in  Figure  <4. 
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Figure  4^ 

A Search  Involving  a Terminal  Payoff 


A target  begins  a maneuver  at  position  Pi.  The  goal  of  this 

. t 

maneuver  is  to  penetrate  the  screen  of  searching  units,  located  at  . 

position  Si,  52,  and  S3,  ana  to  arrive  at  some  position  on  the  dotted 

circle  surrounding  the  SVU,  the  high  value  unit.  Upon  arriving  at  the 

dotted  circle  the  target  receives  a payoff.  If  the  purpose  of  the 

target's  penetration  is  to  attack  the  HVU,  then  the  payoff  might  be  the 
probability  with  which  the  attack  is  successful. 

It  may  be  the  case  that  some  positions  on  the  dotted  circle  are 

advantageous  positions  from  which  to  launch  an  attack.  These 


positions  would  have  a higher  payoff  than  those  from  which  an 
attack  is  more  difficult.  But  we  assume  that  the  target's  pri- 
mary problem  is  reaching  the  dotted  circle  and  once  on  the 
ciroltt*  it  takas  the  payoff  associated  with  the  point  of  initial 
contact. 

The . penetrating  target  may  not  roach  the  circle  at  all.  We 
assume  that  each  of  the  (searching  units  SI,  82,  and  S3  remains 
stationary  relative  to  th*  ttvtl  (which  may  move) ; but  detects  the 
target according  to  a detection  rate  which  is  a function  of  the 
position  of  the  target  relative  to  tha  sensor.  We  assume  that  if 
the  target  is  detected  during  penetration,  it  is  somehow  neutralised 
and  therefore  receives  no  payoff. 

From  Figure  4^  it  Beetns  apparent  that  some  starting  positions 
for  the  target  are  better  than  others.  For  example,  a target  start- 
ing from  position  Pi  has  more  defenses  to  penetrate  than  a target 

starting  from  position  P2.  fconsequently,  this  target  has  more  of  a 

* . *.  ' , 

chance  of  being  neutralized  than  a target  starting  from  position  P2. 
However,  as  was  pointed  out  above,  merely  having  a high  probability 
of  successful  penetration  does  not  guarantee  a high  payoff.  This 
is  because  a target  starting  from  position  P2,  for  example,  may 
arrive  at  a position  on  the  dotted  circle  with  a low  payoff. 
Tharafor®,  the  best  starting  positions  for  a penetrating  target 
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are  theaa  which  balance  the  penetration  probability  against 
the  terminal  payoff.  Tha  beat  initial  positions  are  those  which 
give  a reasonably  high  penetration  probability  and  a good  payoff. 


One  way  to  judge  the'  effectiveness  of  a defensive  plan  is  dis- 
played in  Figure  £ would  be  to  determine  where  all  the  best  initial 
position^  for  a penetrating  target  might  baj  and  to  design  a defense 
which  makes  the  expected  payoff  to  a target  starting  from  one  of 
these  positions  as  low  aa  possible.  The  solution  of  this  prob- 
lem will  be  discussed  below.  One  technical  report  has  been 
written  on  this  topic.  Possible  applications  for  this  technique 
are  also  discussed  below. 

A.  Computing  the  Search  Potential 

' The  problem  of  evaluating  the  expected  payoff  to  a penetrating 
target  may  be  considered  within  the  context  of  Btochastic  processes. 
One  of  the  principle  sources  of  uncertainty  in  the  payoff  to 
the  target  is  the  uncertainty  involved  in  the  target's  motion.  Only 
one  path  for  each  target  was  drawn  in  Figure  4.  However,  in  an 
actual  tactical  situation  many  paths  are  possible  between  a given 
starting  position  and  the  payoff  circle  about  the  HVU.  Some  possi- 
ble penetration  paths  are  drawn  in  Figure  5_.  This  implies  that  a 
stochastic  model  for  target  motion  might  be  a realistic  one. 
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As  io  indicated  in  Figure  5^  , for  a given  Btarting  position  P , 
many  penetration  paths  are  possible.  Different  penetration  paths 
have  differont  values  of  expected  payoff.  This  is  due  to  the  fact 
that  different  pathsl  have  different  probabilities  of  being  detected 
and  different  payoffs. 

The  problem  outlined  in  the  previous  section  reduces  to  comput- 
ing a particular  kind  of  average.  For  each  possible  starting  posi- 
tion P outside  the  defenses, the  average  payoff  over  all  possible 
paths  originating  at  that  point  and  ending  on  the  payoff  circle  must 
be  computed.  If  it  is  assumed  that  the  target  moves  according  to  a 
homogeneous  Markov  process  and  that  the  sensors  are  stationary  relative 
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to  the  HVU,thiB  average  is  easily  computed.  If  this  average  is 
plotted  against  initial  target  position/  a function  called  the 
search  potential  results.  This  function  gives  the  potential  pay- 

i ^ * 

gff  to  an  undetected  target  as  a function  of  initial  position. 

B.  Technical  Report 

One • technical  report  was  written  under  this  contract  on  the 
employment  of  the  search  potential.  This  report  ie  entitled 
The  Search  Potential.  It  is  abstracted  in  section  7. 

C.  Discussion  of  Technical  Report 

In  the  above  technical  report  a Bearch  for  a target  in  dis- 
crete' Markov  motion  is  considered.  The  search  potential  function 

f 

1b  defined  as  a function  defined  on  the  states  of  the  Markov 

«• 

chain  with  non-zero  prior  probability,  which  i3  the  expected  pay- 
off to  an  undetected  target  upon  being  absorbed  in  the  terminal 
states  of  the  chain.  , A method  for  computing  this  function  is 

t 

presented  and  three  examples  are  worked. 

r • 1 

D.  Application  of  the  Search  Potential 

i)  General  Considerations ; The  two  key  assumptions  in  the 
above  technical  report  involve  the  homogeneity  of  the  assumed 
Markov  motion  for  the  target  and  the  stationarity  of  the  sensors 
relative  to  the  HVU.  These  assumptions  restrict  the  usefulness  of 
the  technique  to  situations  in  which  the  sensors  are  screening  the 

high  value  unit.  In  such  situations  the  screening  units  and  the  high 

> 

value  unit  move  in  unison  and  the  penetration  tactics  of  the  target  are 


Li 
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likely  to  depend  on  its  position  in  the  search  space,  but  not  on  the 
time  of  penetration. 

Thus,  the  most  fruitful  area  of  application  for  these  techniques 

• i 

is  in  direct  support.  The  search  potential  would  provide  a way  of 
evaluating  the  screen  of  a task  force  in  terms  of  its  ability  to  pre- 
vent a penetrating  target  from  carrying  out  its  mission. 

ii)  Specific  Considerations ; The  algorithm  presented  in  the 
technical  report  may  be  programmed  on  a desk  top  calculator.  Programs 
for  direct  support  search  planning  and  evaluation  are  currently  imple- 
mented on  the  Wang  2200.  The  program  ASP  developed  at  the  SUBPAC  TAG  is 
written  specifically  for  direct  support  applications.  The  algorithm 

r 

presented  above  could  also  be  written  for  the  Wang  2200  and 
included  as  part  of  the  ASP  programs.  This  would  provide  the  ASP 
programs  with  a tool  specifically  designed  to  evaluate  HVU  screens — 
a tool  which  ASP  does  not  currently  have. 


-37- 


. Abstracts  oC  Technical  Reporta 

1 . Search  for  a Moving  Target  and  The  Exponential  Formula 

(JHU  Technical  Report  No.  27Q) 

* » 

Abstract 

. A target  is  assumed  to  move  according  to  a Wiener  Process 
in  IR^  . The  probability  of  detecting  the  target  is  computed 
in  terms  of  the  search  effort  which  accumulates  along  the  tar- 
get's path.  Under  regularity  assumptions  this  probability  is 

i 

given  by  the  expectation  of  an  exponential  functional  of  the 

process.  The  problem  treated  here  is  that  of  determining  the 

probability  of  detecting  the  target  in  a giv£n  cell  of  finite 

Lebesque  measure.  In  stationary  searches  this  probability  is 

often  approximated  using  the  exponential  formula  evaluated  at 

the  total  accumulated  search  effort  in  the  cell.  It  is  shown 

here  that  the  cell  faiiure  probability  in  a search  for  a Wiener 

-1/2 

target  is  asymptotically  proportional  to  T rather  than 

expf-pT]  , where  T is  accumulated  time  spent  searching  in  the 
cell.  The  asymptotic  failure  probability  is  also  shown  to  be  a 


function  only  of  cell  size,  not  cell  position  in  IR1  . In  a 
similar  fashion  it  is  shown  the  cell  failure  probability  in  a 


. Statistical  Methods  in^  the  Theory  of  Search 


(JHU  Technical  Report  No.  280) 

' Abstract 

A target  is  assumed  to  move  according  to  a continuous 

I 

stochastic  process  in  Euclidean  IR  . A searcher  makes  a 
selection  of  a search  strategy  from  among  a set  of  alter- 
natives. The  state  of  the  searcher’s  knowledge  during  the 
course  of  the  search  is  modeled  as  a two-state  continuous- 
time Markov  chain,  called  the  detection  process.  The  two 
states  are  assumed  to  be  "out  of  contact"  and  "in  contact". 
The  transition  intensity  of  the  detection  process  at  any 
time  t is  assumed  to  depend  upon  the  search  strategy 
chosen,  the  target's  position  at  time  t , and  t itself. 
It  is  shown  that  the  I53yes  estimator  for  target  location  at 
any  time  during  the  search  is  determined  by  a family  of 
probability  measures  derived  from  the  search,  called  the 
coverage  distributions.  Techniques  for  approximating  the 
Dayes  estimator  based  upon  known  properties  of  the  coverage 
distributions  are  discussed.  The  methodology  developed  is 
discussed  in  terms  of  an  example. 


Parametric  Search  Modalirv 


(SHU  Technical  Report  No.  283) 

t 

Abstract 

A target  move a according  to  a continuous  stochastic  pro- 
cess. in  Euclidean  ]Rn  . A search  is  conducted  by  chosing  a 
search  strategy  and  by  observing  events  of  a detection  pro- 
cess. Methods  for  representing  the  posterior  distribution 

Kr 

. for  target  location  at  any  time  during  the  Bearch  are  die- 
cuaeed.  The  particular  methods  for  parameterizing  the 
models  for  target  motion  and  the  transition  vector  of  the 
detection  proceaa  which  yield  tractable  representations  are 
introduced.  The  methodology  is  discussed  in  terms  of  two 
examples . 

i 
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4 . On  Multiplicative  Functionals  on  Diffusion  Processes 
(JHO  Technical  Report  No.  28G) 


Abstract 

A clttaa  of  Gaussian  DifEuaion  procoauea  is  considered.  A 
multiplicative  functional  i3  defined  on  such  a proces3  and  gives 
rise  to  a generalized  transition  function.  Thio  generalized 
transition  function  satiofies  a modified  version  of  the  Kolmogorov 
backward  equation  of  the  diffusion  process.  A constructive  method 
for  generating  a solution  to  this  modified  backward  equation, 
with  the  required  final  condition, is  presented.  The  methodology 

r 

is  discussed  in  terms  of  an  example. 

5.  Search  For  a Stationary  Target  Under  Minimax  Estimation 
(utttr  Technical  Report  No.  291) 

i 

' Abstract 

A target  in  assumed  hiding  at  an  unknown  position  in  a finite 
search  space.  No  prior  probability  distribution  for  target  loca- 
tion is  assumed.  A search  in  defined  to  be  the  observation  of  a 
sequence  of  randetn  variables.  Expressions  for  the  mlnimax  esti- 
mator for  target  location,  the  least  favorable  prior  distribution 
for  target  location,  end  the  value  of  the  estimation  game  at  any 
stage  of  the  search  are  derived.  The  methodology  is  illustrated 
in  term  of  an  example. 
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6.  Search  for  a Movl  ng  Target  Under  Mlnltuax  Estimation 
(JHU  Technical  Report  No.  295) 

Abstract 

A target  is  assumed  to  choose  its  starting  position  in  a 
aeareh  at  an  unknown  position  in  a finite  search  space.  No. 
prior  probability  distribution  for  the  target’s  initial  loca- 
tion is  assumed.  During  the  search  the  target  ie  assumed  to 
move  from  position  to  position  in  the  search  apace  according 
to  a Markov  process.  A search  is  defined  to  be  the  observa- 
tion of  a sequence  of  random  variables.  Representations  for 
the  minimax  estimator  for  target  location  at,any  3tage  of  the 
search,  the  least  favorable  prior  distribution  for  the  target, 
and  the  value  of  the  estimation  game  are  presented. 


I 

I 


!. 
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7 . The  Search  Potential 

(JItU  Technical  Report  Me.  297) 

Abstract 

A search  for  a particle  in  discrete  Markov  motion  is  con- 
sidered. The  states  of  the  particle's  motion  are  assumed  to  be 
either  transient  or  absorbing.  An  operator  called  the  search 
potential  operator  is  defined.  This  operator  mapB  real-valued 
functions  defined  on  the  absorbing  states  into  real-valued 
functions  defined  on  the  transient  states.  If  a function  de- 
fined on  the  absorbing  states  is  construed  to  be  the  payoff  to 
an  undetected  particle  upon  being  absorbed,  then  the  search 
potential  operator  maps  it  into  the  conditional  expectation  of 
payoff  as  a function  of  starting  state.  Three  examples  are 
provided . 


•i 
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8.  Maximum  Likelihood  Search 


(JHU  Technical  Report  No.  301) 

Abstract 

A target  is  assumed  located  at  an  unknown  position  in  IR*1 
No  prior  probability  distribution  for  the  target  i9  assumed. 

A Bearch  is  defined  to  be  the  observation  of  a Sequence  of 
Bernoulli  random  variables.  The  maximum  likelihood  estimator 
for  target  location  is  examined.  In  particular, the  asymp- 
totic distribution  of  the  maximum  likelihood  estimate*  is 
derived  and  use"  df  Fiaher  Information  is  mads  for  the  optimal 
selection  of  the  sequence  of  Bernoulli  random  variables  to  bs 


sampled . 
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